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Abstract 

In research on parental involvement and teacher professionalization, counseling parents on the support of their 
children’s learning processes is considered to be an increasingly important competence area of teachers. 
However, to date little research has been conducted on the development of appropriate approaches to the 
assessment of teachers’ counseling competence. The current study describes the validation of a behavior-based 
instmment for the assessment of teachers’ counseling competence including counseling talk simulations with 
standardized parents as well as the examination of its suitability as an intervention for the improvement of 
participants’ counseling competence. The validation was carried out within the framework of a longitudinal 
quasi-experimental study with 51 prospective teachers. Multivariate repeated measures MANOVAs revealed the 
suitability of the counseling talk simulations both as an assessment instmment and an intervention. Results 
provide numerous implications for teacher preparation and continuing education, for example, the use of the 
counseling talk simulations as a didactical tool within the framework of teacher training programs. 

Keywords: behavior-based competence assessment, counseling talk simulations, counseling competence, 
intervention, teacher education 

1. Introduction 

Counseling students and their parents is considered to be an increasingly important task for teachers (Guli, 2005; 
Valli & Rennert-Ariev, 2000). Consequently, it has even been specified as a key aspect in recent concepts of 
teachers’ professional competences (e.g., Baumert & Kunter, 2006) as well as world-wide government 
recommendations and standards for teacher education (e.g., National Commission on Teaching and America’s 
Future, 1997; Standing Conference of the Ministers of Education and Cultural Affairs of the States in the Federal 
Republic of Germany, 2004). In particular, counseling parents concerning the support of their children’s learning 
activities plays an increasingly important role (Whiston, Tai, Rahardja, & Eder, 2011), as research on parental 
involvement has frequently demonstrated its beneficial effects on students’ academic development as well as 
their social, emotional, and behavioral adjustment (Cox, 2005; Hill & Tyson, 2009; Pomerantz, Moorman, & 
Litwack, 2007). Especially home-based involvement practices, such as providing assistance with homework, 
enhancing motivation, and structuring time for homework and leisure, have been shown to improve academic 
achievement (Fan & Chen, 2001; Henderson & Mapp, 2002). Consequently, parents increasingly request 
guidance from teachers concerning the support of their children in homework and learning activities 
(Hoover-Dempsey, Walker, Jones, & Reed, 2002). Consequently, in order to meet these high demands and 
capitalize on the full potential of involving parents in their children’s learning processes, teachers have to 
possess essential counseling competences. 

1.1 Assessment of Teachers ’ Counseling Competence 

Although the current state of research clearly emphasizes the prominent role of teachers’ counseling competence 
in parent-teacher talks in the development of high-quality educational processes, there has been little research on 
this important teacher competence. Approaches to the measurement of teachers’ counseling competence in 
parent-teacher talks, in particular, are still rare. To date, there are only a few instalments for its standardized 
assessment, which are primarily based on self-reports. For example, Hertel (2009) developed a self-assessment 
questionnaire for the measurement of teachers’ counseling competence including the scales personal resources, 
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social cooperation competence, counseling skills and pedagogical knowledge, process competence, and coping. 
However, instead of capturing a person’s real competences in specific situations, self-reports are more likely to 
record an individual’s general self-concept (Spencer & Spencer, 1993) or the importance assigned to a specific 
behavior (Constantine & Ladany, 2000). On this account, approaches to the more objective and contextual 
assessment of teachers’ counseling competence in parent-teacher talks are necessary. 

To this, Btuder (2011) developed and validated a Situational Judgement Test (SJT) for the assessment of 
teachers’ counseling competence in parent-teacher talks. As SJTs have been shown to have substantial 
criterion-related validities for the criterion of job performance (McDaniel, Morgeson, Finnegan, Campion, & 
Braverman, 2001), the author considered the SJT approach to be a promising method for measuring teachers’ 
counseling competence in a behavior-based manner. The author developed 13 items measuring the scales 
counseling skills, diagnostic and pedagogical knowledge, collaboration and perspective taking, and coping. Each 
of the 13 items describes a short, realistic parent counseling situation in which a specific behavior is requested 
followed by four multiple-choice answer options presenting a range of possible activities. The participant is 
asked to choose the best and worst possible activities. In a subsequent study, Brnder, Keller, Klug, and Schmitz 
(2011) additionally established a short test form of the SJT including 6 of the original 13 items. 

1.2 Scenario Test for the Assessment of Teachers ’ Counseling Competence 

To date, one of the best validated instruments for the assessment of teachers’ counseling competence in 
parent-teacher talks on the support of students’ educational processes is a scenario test established by Binder 
(2011) and Gerich, Binder, Hertel, Trittel, and Schmitz (2015). The scenario test is based on the model of 
teachers’ counseling competence in parent-teacher talks on the support of students’ learning processes (in the 
following, we use the abbreviated term “counseling competence”) by Gerich et al. (2015, see Figure 1). This 
four-dimensional model was developed on the basis of literature on general counseling competence, counseling 
in schools, parent counseling, and counseling on learning strategies (e.g., Guli, 2005; McLeod, 2003; Sheridan, 
Kratochwill, & Bergan, 1996) as well as preliminary approaches to modeling teachers’ counseling competence 
for the subsample of higher track secondary school teachers (Binder, 2011; Hertel, 2009). The proposed model 
structure was empirically validated conducting structural equation modeling on the basis of 357 primary and 
secondary school teachers’ data. The model includes the most important skills and abilities that a teacher should 
possess in the context of counseling parents in how to support their children’s educational progress: (1) 
communication skills, containing general counseling practices such as “active listening”, “paraphrasing”, and 
“structuring” the talk; (2) diagnostic skills, including aspects necessary to analyze existing problems and identify 
potential causes such as “problem definition”, “search for possible causes”, and “perspective taking”; (3) 
problem-solving skills, comprising aspects necessary to develop and initiate appropriate and customized 
solutions for learning difficulties such as “application of learning strategies”, “goal orientation”, “solution and 
resource orientation”, and “cooperative actions”; and (4) coping skills, including strategies for “coping with 
criticism” and “dealing with difficult situations” in the course of the counseling talk. In addition to these four 
dimensions, the authors identified several specific variables that are positively related to the level of teachers’ 
counseling competence: knowledge of counseling and learning strategies, professional self-concept as a 
counselor, and counseling experience (in the following, these terms are used interchangeably with the 
abbreviations “knowledge”, “professional self-concept”, and “experience”). 

The scenario test was developed for the assessment of teachers’ counseling competence both overall as well as 
subdivided into the four competence dimensions. As scenario tests have been shown to be appropriate to 
measure competences in a standardized and economical manner that is context specific and closely related to 
behavior (Hedlund, Witt, Nebel, Ashford, & Sternberg, 2006), they have often been used in research on 
professional competences, even in the field of teacher competences (e.g., Klug, Binder, Kelava, Spiel, & 
Schmitz, 2013). The scenario test for the assessment of teachers’ counseling competence contains a case study of 
a student with learning difficulties whose mother is seeking advice and thus requests a counseling talk. 
Participants are requested to respond to 12 open-ended questions referring to the information given in the case 
study. These questions represent the 12 content variables of the four dimensions of teachers’ counseling 
competence (e.g., “What information would you collect prior to and during the talk with Kristina’s mother in 
order to find possible solutions to implement after the talk?” for the variable search for possible causes). In the 
evaluation of participants’ responses, the qualitative statements are converted into quantitative scores by means 
of a detailed rating system (for a comprehensive description of the scenario test, its development and validation, 
see Binder (2011) and Gerich et al. (2015)). 
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Figure 1. Model of teachers’ counseling competence (Gerich et al., 2015) 


1.3 Behavior-Based Instruments for the Assessment of Teachers ’ Counseling Competence 

In the studies by Bruder (2011) and Gerich et al. (2015), the scenario test has been shown to be an objective and 
economic strategy for the itemized measurement of teachers’ counseling competence. Nevertheless, 
behavior-based instruments for the assessment of teachers’ counseling competence, for example, direct 
performance observation in concrete and realistic application situations (Kane, 1992), have yet to be developed. 

In this context, a promising alternative is the performance observation in videotaped simulated parent-teacher 
talks involving role-playings with standardized parents. This approach appears to be suitable, as the level of 
counseling competence measured in role-play situations has already been shown to largely correspond to the 
level of counseling competence demonstrated in real counseling talks in a study with counseling students 
(Gallagher & Hargie, 1989). Moreover, because video recording has been shown to be an appropriate and valid 
strategy for the simultaneous assessment of multifaceted pedagogical skills, especially in the field of counseling 
(e.g., Admiraal, Hoeksma, van de Kamp, & van Duin, 2011), this method also appears appropriate for measuring 
teachers’ counseling competence in simulated parent-teacher talks on the support of students’ learning processes. 

One of the first approaches of applying simulated parent-teacher talks in the field of teacher education was 
established by Dotger and colleagues (Dotger, Dotger, & Maher, 2010; Dotger, Harris, & Hansel, 2008). In the 
Simulated Interaction Model (SIM), prospective teachers participate in a series of one-on-one interactions with 
standardized parents within the framework of a teacher training course. These standardized parents are carefully 
trained actors who are scripted to present specific statements, questions, or concerns-known as “verbal 
triggers”-during the parent-teacher talk simulations in accordance with a carefully designed case profile. In 
contrast, the teacher candidate taking part in the simulation is given an “appropriate” amount of background 
knowledge regarding the hypothetical student in terms of a general academic profile, but is not scripted in any 
way concerning his or her behavior during the interaction with the standardized parent. The simulated 
parent-teacher talks are videotaped in order to subsequently provide participants extensive feedback on their 
performance during the simulations. Furthermore, participants conduct detailed self-evaluations, supported by 
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their careful review of the video recordings of their simulated interactions as well as individual and whole-group 
debriefing sessions. 

In the first instance, the SIM was developed as an intervention for enhancing prospective teachers’ 
communication skills in parent-teacher talks. In a subsequent study. Walker and Dotger (2012) utilized the 
videotaped simulations to measure prospective teachers’ readiness for parent-teacher interactions. In this context, 
the videotaped simulations functioned as models of effective and less-effective teacher-parent communication. 
After reading the related background information of the hypothetical student and before viewing the respective 
videotaped simulation, participants were asked what they would do to make the talk successful, what strategies 
they would use, and what else they would like to know, if they were the teacher in this situation. Subsequently, 
candidates watched two videos that involved two different teacher models interacting with the same standardized 
parent and evaluated the teachers’ performance along several dimensions derived from expert opinion. Moreover, 
candidates chose which of the two models performed better. Although Walker and Dotger (2012) used simulated 
parent-teacher talks, participants’ conversation competences were not assessed via participants’ own behavior in 
the specific situation. Instead, they were measured by means of participants’ theoretical descriptions of how they 
would act in the given situation as well as their rating of the demonstrated conversational skills of specified 
teacher models. 

A first attempt to measure prospective teachers’ own behavior in simulated parent-teacher talks was introduced 
by Wiesbeck, Bauer, Gartmeier, and Prenzel (2013). By means of videotaped simulations with standardized 
parents, the authors aimed to assess prospective teachers’ communicative competence in parent-teacher talks-a 
construct related to teachers’ counseling competence. For the evaluation of the videotaped conversations, the 
authors applied a detailed rating system based on the study’s underlying Munich model of teachers’ 
communicative competence in parent-teacher talks (Gartmeier, Bauer, Fischer, Karsten, & Prenzel, 2011) 
comprising the three facets interpersonal relationship, problem-solving, and structuring the conversation. 

1.4 Purpose of the Current Study 

Even though Dotger et al. (2008, 2010) as well as Wiesbeck et al. (2013) already developed behavior-based 
simulation approaches to the assessment of teachers’ communication skills, there are still no instruments for the 
behavior-based assessment of teachers’ counseling competence in parent-teacher talks on the support of 
students’ learning processes. Therefore, the superior aim of the current study was to develop and validate a 
behavior-based instrument based on the four-dimensional model of teachers’ counseling competence (Gerich et 
al., 2015) involving counseling talk simulations with standardized parents in the same style of the SIM approach 
by Dotger et al. (2008, 2010) as well as the assessment approach by Wiesbeck et al. (2013). Here, in order to 
particularly utilize the instrument for the evaluation of specific teacher training programs on counseling, we 
strove for an instrument for the longitudinal assessment of changes in teachers’ counseling competence due to 
specific interventions. For validation purposes, we aspired to compare longitudinal data acquired by means of the 
counseling talk simulations with longitudinal data gathered by means of the already established scenario test by 
Bruder (2011) and Gerich et al. (2015) described above. 

In addition to its utilization as a measurement instrument, we aimed to examine whether participation in the 
counseling talk simulations could serve as an intervention for the improvement of prospective teachers’ counseling 
competence within the context of teacher preparation. In the studies carried out by Dotger et al. (2008, 2010), 
participation in simulated parent-teacher talks provided prospective teachers an opportunity to practice their 
abilities to effectively partner with parents and, subsequently, led to an enhancement of participants’ 
communication skills. The beneficial effects of practicing professional skills in concrete case-based application 
situations on the development of competences have also been demonstrated in other studies on teacher education 
(e.g., Grossmann, 2005). By means of active learning, learners are given the possibility to apply their theoretical 
knowledge in practical, realistic situations in order to acquire practical competences, gain experience, and 
facilitate the transfer of training content to future professional routines. Based on this, active learning by the use 
of videotaped simulated parent-teacher talks appears to be a promising opportunity even in the context of 
enhancing prospective teachers’ counseling competence in parent-teacher talks on the support of students’ 
learning processes. 

In summary, the present study addressed the following hypotheses: 

1) The counseling talk simulations serve as an appropriate instrument for the assessment of changes in 
prospective teachers’ counseling competence due to specific interventions. It is expected that intervention effects 
on teachers’ counseling competence measured by means of the counseling talk simulations are consistent with 
measurements determined by means of the scenario test (Bruder, 2011; Gerich et al., 2015). 
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2) The counseling talk simulations serve as an effective intervention for the improvement of prospective 
teachers’ counseling competence. It is expected that participation in the counseling talk simulations leads to an 
increase in teachers’ counseling competence as well as the related variables (knowledge of counseling and 
learning strategies, professional self-concept as a counselor, counseling experience) identified by Gerich et al. 
(2015). 

2. Method 

2.1 Sample 

The study took place at a university in the German federal state of Hesse within the scope of an optional training 
module on educational psychology for prospective teachers. The total sample consisted of 51 prospective 
teachers (66.7% women) ranging in age from 21 to 34 years (M = 23.06, SD = 2.20) who were currently in 
semester 2 through 10 of their studies (M = 6.65, SD = 1.66). 23 (45.1%) prospective teachers studied 
mathematics, 25 (49.0%) natural sciences, 8 (15.7%) languages, 20 (39.2%) social sciences, and 12 (23.5%) art, 
music, and/or physical education. None of the participants had previously gathered initial experiences in 
counseling parents; six students (11.8%) had previously participated in courses on counseling. 

2.2 Procedure 

The longitudinal study was carried out within the framework of a quasi-experimental study on the evaluation of a 
training program on counseling competence for prospective teachers (for a detailed description of the training 
program and its evaluation, see Gerich, Trittel, & Schmitz, under review). In order to examine our research 
questions, we observed two experimental groups. The design was quasi-experimental, because the participants 
could not be randomly assigned to the intervention groups. Instead, the groups established themselves by the 
students’ optional enrollment in one of two training courses. However, participants did not know about the 
different experimental conditions. The experimental groups did not significantly differ with regard to their 
demographic data. 

Both experimental groups (experimental group 1 [EG1]: N = 25; experimental group 2 [EG2]: N = 26) 
participated in the training program as separate groups. The training program consisted of nine weekly sessions 
of 100 minutes each. Prior to and after receiving the training intervention, participants completed an extensive 
paper-pencil survey (paper-pencil pretest and posttest) for the assessment of participants’ counseling competence, 
knowledge, professional-self concept, and experience, based on the four-dimensional model of teachers’ 
counseling competence (Gerich et al., 2015). Experimental group 1 additionally participated in the simulated 
parent-teacher counseling talks at two different points in time (simulation pretest and posttest). The simulation 
pretest took place one week after the paper-pencil pretest and the simulation posttest was carried out one week 
before the paper-pencil posttest. 

2.3 Measures 

2.3.1 Paper-Pencil Tests 

Within the framework of the paper-pencil pretest and posttest, participants’ counseling competence was 
measured by means of the aforementioned scenario test established by Brnder (2011) and Gerich et al. (2015) 
(see section Introduction). Participants’ responses to the 12 open-ended questions following the case 
scenario-which represent the content variables of the four-dimensional model of teachers’ counseling 
competence (Gerich et al., 2015)-were converted into scores from 0 to 2 for each item using a detailed 
standardized rating system. The rating system includes an extensive set of potential answers to each question as 
well as detailed specifications on the respective scores to be awarded. The coding was carried out by well-trained 
raters with sufficient content knowledge on parent counseling and learning strategies. In order to test the 
objectivity of the rating system, and thus its robustness against any personal biases or predispositions of the 
raters, inter-rater reliabilities for each question were calculated in a previous study (Gerich et al., 2015), resulting 
in satisfactory intra-class-correlations (ICC; McGraw & Wong, 1996) between ICC = .72 and ICC = 1.00. 

Moreover, within the paper-pencil pretest and posttest, we measured the three variables, which are positively 
related to the level of teachers’ counseling competence (Gerich et al., 2015): knowledge of counseling and 
learning strategies, professional self-concept as a counselor, and counseling experience. Participants’ knowledge 
of counseling and learning strategies was measured by means of a multiple-choice test composed of nine 
closed-ended questions with four possible answers each. The knowledge test includes four multiple-choice items 
on professional knowledge of counseling (e.g., “What are the advantages of the active listening technique in a 
counseling talk?”) and five items on knowledge of learning strategies (e.g., “Which possibilities does a student 
have to motivate himself/herself while studying?”). Participants are asked to choose the best answer or answers 
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(the latter in cases where multiple answers were allowed, which is clearly marked next to the respective item). 
Participants’ responses to all items are coded as either correct or incorrect. Item difficulties determined in a 
previous study ranged between .35 and .89 and thus fell within an acceptable range for inter-correlated items 
(Ramsey & Reynolds, 2000). The examination of scale reliability in a previous study revealed an acceptable 
Cronbach’s alpha of a = .63. 

The self-assessment questionnaire on professional self-concept as a counselor and counseling experience 
consists of 23 closed-ended items. Participants are asked to respond to each item on a six-point rating scale 
ranging from 1 (I completely disagree ) to 6 {I completely agree). The scale professional self-concept includes 15 
items concerning prospective teachers’ attitudes towards counseling, motivation for counseling, self-efficacy in 
counseling, and sense of self as a counselor (e.g., “I believe that, as a teacher, part of my job is to counsel 
parents.”). The experience scale consists of 8 items on prospective teachers’ previous education and experiences 
in counseling as well as reflection on one’s own counseling behavior in previous counseling talks (e.g., “After 
finishing a counseling talk, I think about whether I am satisfied with my performance as a counselor.”). The 
examination of scale reliability in a previous study indicated satisfactory Cronbach’s alphas of a = .77 for 
professional self-concept as a counselor and a = .86 for counseling experience. 

2.3.2 Counseling Talk Simulations 

The development of the materials for the simulated parent-teacher counseling talks was also based on the model 
of teachers’ counseling competence (Gerich et ah, 2015). We constructed two specific case examples of 
hypothetical students (Manuel for the simulation pretest and Marie for the simulation posttest) with certain 
difficulties in learning that are supposedly causing a decline in their achievement, which formed the basis for the 
preparation of the written instructional materials for the participating teacher as well as the actor portraying the 
simulated parent. 

Similar to the scenario test, the materials for the participating teacher each include a detailed profile of the 
respective student providing general demographics (name, age, grade level), information on the student’s social 
and personal characteristics, and, most importantly, current academic and behavioral conspicuities. Moreover, 
the profile outlines certain educational initiatives already taken by the teacher, previous communication with the 
student’s parents, and the occasion of the upcoming teacher-initiated parent-teacher talk with the student’s 
mother. The profile does not in any way specify exactly the teacher’s actions, decisions, or verbalizations within 
the simulated counseling talk. The instruction materials additionally include the request of the participants to 
carefully read the profile, empathize with the teacher’s character, and prepare for the upcoming counseling talk. 
In addition, participants are informed about the time limit of 15 minutes for the counseling talk. 

For the role of the hypothetical students’ parents, we also constructed detailed instructional materials that 
allowed for the careful preparatory training of the actors portraying the simulated parents within the counseling 
talk simulations. For both of the developed cases, those materials each include a detailed profde of the respective 
hypothetical student. In contrast to the student’s profile presented to the participating teachers, the profile given 
to the simulated parents provides home-based background context as well as a detailed interaction protocol for 
the simulated parent-teacher talk. By means of this interaction protocol, the standardized parents are instructed to 
present exact predetermined questions, information, and statements-according to the verbal triggers in the studies 
by Dotger et al. (2008, 2010)-at specified times during the course of the parent-teacher talk. For instance, after 
the teacher addresses the hypothetical student’s unsatisfactory homework completion, the simulated parent is 
instructed to signalize a certain helplessness concerning the corresponding causes by stating “I am completely at 
a loss as to what could be the problem with his/her homework completion”. This statement is intended to 
examine whether the participating teacher is able to take into account potential causes for students’ learning 
difficulties from different contexts (e.g., insufficient learning strategies, motivational or emotional problems) and 
ask appropriate and purposeful questions. At a later stage in the counseling talk, the simulated parent is 
instructed to suddenly criticize the teachers’ professional practice by stating “I have had a look at your latest 
class test and it is my opinion that the exam questions were much too difficult”, in order to examine the teacher’s 
ability to professionally deal with parental criticism. Even though the standardized parents are instructed to 
closely adhere to the interaction protocol during the counseling talk simulations, they must also adapt to the 
individual conversational actions of the respective participating teacher. Thus, the training of the simulated 
parents particularly focused on additional contingency responses that they may employ during the simulation 
depending of the specific actions of the teacher. Excerpts of the instructional materials for the teacher and 
simulated parent concerning the case example Manuel are shown in Table 1. 
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Table 1. Excerpts of the instructional materials for the teacher and the standardized parent concerning the case 
example Manuel 

Materials for the teacher 
Instruction 

Your task: In a role-play counseling situation, you will conduct a counseling talk with a student’s parent. In order 
to successfully complete the task, it is important that you can identify with your role in the counseling talk. 
Please take your time reading the following scenario description. In the role-play situation, act just as you would 
in a real counseling talk with a parent. The role of the parent will be played by a trained role-player using a 
standardized script. You now have 10 minutes to prepare yourself for the counseling talk. Feel free to make notes 
to help you during the counseling talk. The role-play will last about 15 minutes and will be videotaped. 

Scenario 

You teach seventh grade math at a higher track secondary school. Today you have a counseling talk planned with 
the mother of 12 year old Manuel. Since the beginning of the school year, you have noticed that Manuel’s math 
grades are continually getting worse. He seldom does his math homework. When he does, it is often incomplete 
and sloppy. Because you often teach math during the first period of the day, you have noticed that Manuel is 
often late to school. Otherwise, Manuel is a rather quiet and nice student. You don’t believe that he has any 
cognitive problems; and he seems to understand what you teach in class. During independent work times, Manuel 
is able to concentrate on his work. He also has good social ties to his peers. Based on conversations with other 
students, you know that he is interested in movies, computer games, and soccer. You have never met Manuel’s 
parents, since they have never attended parent-teacher conferences. Manuel’s mother cancelled an appointment 
that you had with her two weeks ago because she did not have time to attend. You asked his mother to participate 
in a counseling talk with you so that you can obtain an impression of Manuel’s learning and homework situation 
at home. You also want to work with her to find ways to improve Manuel’s learning and homework habits. 

Materials for the standardized parent 
Scenario 

You are the mother of 12 year old Manuel. He is in the seventh grade at a higher track secondary school. You 
have always had the impression that he is a relatively good student. However, lately his grades have not been as 
good. You don’t know why that is, since he is an intelligent child. He is constantly demonstrating his ability to 
quickly learn new things when he plays computer games on the weekends with his friends and always ends up 
the winner. He also often watches sophisticated movies and really enjoys thinking up new strategies for his 
soccer team. You promised him that you would finally make it to one of his games to cheer him on, but for the 
last year you have been working so much that you are usually grateful just to make it home in time for a family 
dinner. Your partner is also often away on business, so you are very proud that Manuel is such an independent 
child. In the mornings, Manuel has to get ready for school on his own, since you leave the house before he does. 
Still, you always take the time to make breakfast for him and pack his lunch, even though you think he is too old 
for that. However, you do regret the fact that you are so busy at work. For example, you would really like to be 
able to attend a parent-teacher conference so that you can talk with Manuel’s teachers and other parents. Two 
weeks ago you even had to cancel an appointment with Manuel’s math teacher because you just didn’t have the 
time to go. Because of that, you are really glad that his teacher has made another appointment with you. You are 
truly interested in learning about how Manuel behaves at school and what type of student he is. Unfortunately, 
you don’t have the opportunity at home to see how and when he studies and does his homework; and there must 
be some reason why his grades have gone down... So now you are on your way to the appointment with 
Manuel’s math teacher and are really curious to hear what he/she has to say! 

Examples of the predetermined questions, information, and statements 

• After Manuel’s problems have been mentioned, ask at some point during the talk what you could do to 
improve Manuel’s performance (if the teacher does not mention this without you asking): “What can we do to 
help Manuel do better again at school? ” 

• After the teacher has suggested possible interventions, ask him/her to describe them in detail and ask what 
exactly you can do as a parent (if the teacher does not mention this without you asking): “Unfortunately, I 
don’t know anything about this method. Can you tell me more about it, especially what exactly I should do? ” 

• Express critique regarding the teacher’s ability to control the class: “Manuel told me that he can’t concentrate 
in class because it is often so loud. So it’s not surprising that he isn’tperforming up to his usual standard. I’m 
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starting to think that yon don't have your class under control. After all, it’s your job to make sure that the 
students can concentrate on their work! ” 


The simulations took place in a conference room of the research institution equipped with a table, two chairs, 
and a video camera. Each simulation began with a preparation phase in which the written case profile of the 
hypothetical student as well as additional written instructions were presented to the participants. Participants 
were given ten minutes to read the profile, prepare for the upcoming parent-teacher talk, and ask potential 
comprehension questions to the test administrator. The preparation phase was followed by the actual counseling 
talk phase. The video camera was activated, the simulated parent entered the room, and the conversation took 
place. After the teacher finished the talk, the simulated parent left the room and the video camera was switched 
off. In the case that the teacher did not bring the counseling talk to an end after a maximum of 15 minutes, the 
simulated parent terminated the conversation. 

To analyze the participants’ professional performance during the counseling talk simulations, we developed a 
detailed standardized rating system also based on the model of teachers’ counseling competence (Gerich et ah, 
2015). By means of this rating system, participants’ qualitative statements were converted into quantitative 
scores from 0 to 2 for each of the competence aspects outlined in the model (except perspective taking, as this 
aspect could not be adequately observed). 

With reference to the evaluation system of the already well-established scenario test for the assessment of 
teachers’ counseling competence (Binder, 2011; Gerich et ah, 2015), we defined precise encoding rules 
specifying which criteria need to be fulfilled to achieve one or two points as well as appropriate verbalization 
examples for the teacher. The coding was carried out by well-trained raters with sufficient content knowledge on 
parent counseling and learning strategies. Excerpts of the rating system are displayed in Table 2. 

To verify the content validity of the applied case examples, we carried out an expert survey among a sample of 
41 practicing teachers, as expert opinion is considered to be a standard method of establishing content validity 
(Carmines & Zeller, 1991). The sample consisted of 25 (61%) female and 16 (39%) male teachers ranging in age 
from 30 to 60 years ( M = 42.05, SD = 11.00), with M = 12.76 ( SD = 9.55) years of teaching experience. The 
respondents were asked to conscientiously read the two case profiles of the hypothetical students and, for each 
case, answer two questions on a six-point rating scale ranging from 1 (/ completely disagree ) to 6 (/ completely 
agree): (1) “As a whole, 1 judge the depicted case example to be realistic”; (2) “The depicted case example 
describes a typical parent-teacher talk situation with a focus on learning guidance”. Results indicated that the 
experts viewed the case examples to be realistic ( Manuel: M= 5.17, SD = .80; Marie: M= 4.63, SD = 1.14) and 
typical examples of parent-teacher talk situations with a focus on learning guidance {Manuel: M = 5.02, SD = 
1.04; Marie: M= 4.53, SD = .85), indicating a high degree of content validity for the applied case profiles. In 
order to test the objectivity of the rating system, a random selection of 18 videotaped simulations was scored by 
two independent raters. Inter-rater reliabilities for each variable resulted in satisfactory intra-class-correlations 
(ICC; McGraw & Wong, 1996) between ICC = .76 and ICC = 1.00. 

2.4 Analyses 

Data analyses were performed using the software package SPSS Statistics Version 22. For all inferential statistics, 
the respective assumptions for the computed analyses were met. To examine the appropriateness of the 
counseling talk simulations to assess changes in prospective teachers’ counseling competence due to specific 
interventions (hypothesis 1), we performed multivariate repeated measures MANOVAs with the within-subjects 
factor time (pretest, posttest) for the simulation and scenario test data of the experimental group 1. Subsequently, 
we compared the results received from the counseling talk simulations with the results received from the 
scenario test. To investigate the suitability of the counseling talk simulations as an effective intervention for the 
improvement of prospective teachers’ counseling competence, knowledge, professional self-concept, and 
experience (hypothesis 2), we performed an additional multivariate repeated measures MANOVA for the 
experimental groups 1 and 2 with the between-subjects factor group (EG1, EG2) and the within-subjects factor 
time (pretest, posttest) on the basis of the paper-pencil data. 
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Table 2. Excerpts of the rating system for the analysis of the counseling talk simulations 

Dependent 

Variable 

Score 

Criteria 

Exemplary statements or questions 

Paraphrasing 

1 

Use of conversation techniques 
Paraphrasing (repeating in your own 
words what the parent has said) at an 
appropriate point in the talk 

“IfI understand you correctly, you think... 

“In other words... ” 


2 

Use of conversation techniques 

Paraphrasing at at least two appropriate 
points in the talk 

“IfI understand you correctly, you think... 

“In other words... ” 

Search for 

possible 

causes 

1 

Naming possible causes; asking about 
possible causes 

“I think your child’s grades have gone down 
because he is no longer motivated. 

“What do you think has caused your child’s 
grades to go down? ” 


2 

Detailed inquiries concerning learning 
and homework situation 

“Does your child have his own desk at 
home? 

“ When does your child do his homework? ; 

“Does your child make a learning plan when 
he is studying for a test? ” 

Strategy 

application 

1 

Suggest an appropriate solution (e.g., 
homework journal, learning plan, 
checklists, learning contract, reward 
system, mistake analysis, etc.) 

+ explanation of practical 
implementation 

"I would suggest that your child keep a 
homework journal in the next few weeks. 

“It might help to make a weekly plan. 

“ With other students who had similar 
problems, I have had good experiences with 
reward systems. ” 


2 

Suggest several appropriate solutions 
(e.g., homework journal, learning plan, 
checklists, learning contract, reward 
system, mistake analysis, etc.) 

+ explanation of practical 
implementation 

"I would suggest that your child keep a 
homework journal in the next few weeks. 

“It might help to make a weekly plan. 

“ With other students who had similar 
problems, I have had good experiences with 
reward systems. ” 

Cooperative 

actions 

1 

Show understanding; 

Emphasize willingness to cooperate; 

Signal availability for future questions 
and comments 

“I completely understand how you feel. 

“Together we will manage that. 

“If you have any questions, you can always 
contact me. ” 


2 

Show understanding; 

Emphasize willingness to cooperate; 

Signal availability for future questions 
and comments 

_|_ 

“I completely understand how you feel. 

“Together we will manage that. 

“If you have any questions, you can always 
contact me. ” 

_L 



i 

Actively include parent in problem 
definition as well as search for causes 
and solutions; offer support in 
implementing solutions or take on task 
yourself 

i 

“Which of the possible solutions that I 
mentioned do you think would work best with 
your child? 

“I’d be happy to fill out the weekly plan with 
your child. ” 
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3. Results 

3.1 Appropriateness of the Counseling Talk Simulations for the Assessment of Changes in Prospective Teachers ’ 
Counseling Competence due to Specific Interventions 

The repeated measures MANOVAs for the experimental group 1 revealed a significant overall main effect of the 
within-subjects factor time (pretest, posttest) for the simulation data ( Wilks ’ lambda A = .246, F( 4,21) = 16.05, p 
< .001, rf = .75) as well as the scenario test data ( Wilks ’ lambda A = .043, F(4,21) = 116.28 ,p < .001, r\ = .96). 
As hypothesized (hypothesis 1), we found significant positive main effects with large effect sizes (Cohen, 1988) 
measured by means of both instruments with regard to prospective teachers’ overall counseling competence as 
well as the dimensions communication skills, diagnostic skills, and problem-solving skills. Against our hypothesis, 
analyses revealed different results concerning the coping skills dimension. Table 3 displays the comparison of the 
results of the repeated measures MANOVAs for the examination of intervention effects on the basis of the 
counseling talk simulation data and the scenario test data, including pretest and posttest means as well as 
standard deviations. 


Table 3. Results of the multivariate repeated measures MANOVAs for the examination of intervention effects on 
the basis of the scenario test data and the counseling talk simulation data 


Scenario test Counseling talk simulations 


Dependent variables 

Pretest 

Posttest 

Main effect time 

Pretest 

Posttest 

Main effect time 

M(SD) 

M(SD) 

F 

il 2 

M(SD) 

M(SD) 

F 

H 2 

Counseling competence 2 

.83 (.20) 

1.81 (.16) 

396.42 *** 

.94 

.99 (.22) 

1.39 (.18) 

52.96*** 

.69 

Communication skills 2 

.44 (.21) 

1.81 (.32) 

316.88 *** 

.93 

.70 (.26) 

1.10 (.32) 

22.68*** 

.49 

Diagnostic skills 2 

1.42 (.27) 

1.83 (.19) 

29.23 *** 

.55 

1.16 (.37) 

1.58 (.34) 

18.12*** 

.43 

Problem-solving skills 2 

.91 (.29) 

1.84 (.16) 

167.74*** 

.88 

1.05 (.32) 

1.65 (.27) 

61.71*** 

.72 

Coping skills 2 

.54 (.48) 

1.74 (.29) 

157.09*** 

.87 

1.04 (.43) 

1.22 (.50) 

2.45 

.09 


Note. “Range 0-2 (0 = min. parameter value; 2 = max. parameter value). *p < .05. **p < .01. *** p < .001. 


3.2 Appropriateness of the Counseling Talk Simulations as an Intervention 

The multivariate repeated measures MANOVA for the experimental groups 1 and 2 with the between-subjects 
factor group (EG1, EG2) and the within-subjects factor time (pretest, posttest) on the basis of the paper-pencil 
data resulted in a significant overall interaction effect for group * time ( Wilks’ lambda A = .487, F( 7,43) = 6.46, 
p < .001, rf = .513). In accordance with our hypothesis (hypothesis 2), closer inspection revealed significant 
effects with large to medium effect sizes (Cohen, 1988) of participation in the counseling talk simulations on 
prospective teachers’ overall counseling competence, the dimensions problem-solving skills and coping skills, as 
well as knowledge and professional self-concept. For the dimensions communication skills and diagnostic skills 
as well as counseling experience analyses did not reveal significant intervention effects. Pretest and posttest 
means, standard deviations, and results of the repeated measures MANOVA are displayed in Table 4. 
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Table 4. Results of the multivariate repeated measures 
participation in the counseling talk simulations 

; MANOVA for the examination of intervention effects of 

Dependent variables 

Pretest 

Posttest 

Interaction group 

* time 

M(SD) 

M(SD) 

F 

n 2 

Counseling competence a 





14 11*** 

.22 

EG1 

.86 

(-19) 

1.81 

(.15) 



EG2 

.87 

(.15) 

1.58 

(.25) 



Communication skills a 





3.54# 

.07 

EG1 

.44 

(-21) 

1.81 

(.32) 



EG2 

.49 

(.22) 

1.64 

(.40) 



Diagnostic skills a 





2.32 

.05 

EG1 

1.42 

(.27) 

1.83 

(.19) 



EG2 

1.30 

(.31) 

1.55 

(.34) 



Problem-solving skills a 





6.76* 

.12 

EG1 

.91 

(.29) 

1.84 

(.16) 



EG2 

1.05 

(.27) 

1.71 

(.26) 



Coping skills a 





6.79* 

.12 

EG1 

.54 

(.48) 

1.74 

(.29) 



EG2 

.46 

(.40) 

1.25 

(.62) 



Knowledge b 





24.65*** 

.34 

EG1 

5.20 

(1.12) 

7.72 

(.98) 



EG2 

6.38 

(1.02) 

7.19 i 

(1-13) 



Professional self-concept c 





6.65* 

.12 

EG1 

4.50 

(.41) 

5.15 

(-44) 



EG2 

4.48 

(.39) 

4.83 

(.37) 



Experience c 





1.02 

.02 

EG1 

1.95 

(.63) 

3.28 

(.65) 



EG2 

2.13 

(.75) 

3.24 

(.63) 




Note. a Range 0-2 (0 = min. parameter value; 2 = max. parameter value). b Range 0-9 (0 = min. parameter value; 
9 = max. parameter value). Range 1-6 (1 = min. parameter value; 6 = max. parameter value). * p < .05. ** p 

< . 01 . ***P< . 001 . 


4. Discussion 

The central purpose of the current study was to develop and validate a behavior-based instrument for the 
assessment and improvement of teachers’ counseling competence involving counseling talk simulations with 
standardized parents. 

The simulated parent-teacher talks turned out to be an appropriate instrument for the measurement of changes in 
prospective teachers’ counseling competence due to specific interventions. This conclusion is drawn in view of 
the consistencies of the intervention effects of the training program measured by means of the counseling talk 
simulations and the already established scenario test for the assessment of teachers’ counseling competence 
(Bruder, 2011; Gerich et al., 2015) for almost all examined variables. Here, following the approaches established 
by Dotger et al. (2008, 2010) and Wiesbeck et al. (2013) proved to be expedient. The fact that the counseling 
talk simulations were developed on the basis of the four-dimensional model of teachers’ counseling competence 
(Gerich et al., 2015) allows for the behavior-based assessment of teachers’ counseling competence on an overall 
level as well as subdivided into the single dimensions. This, in turn, enables the differential assessment of 
individuals’ and groups’ specific needs, the creation of individual competence profiles, and the subsequent 
design of precisely tailored interventions for specific target groups. Moreover, as the results of the current study 
revealed, the counseling talk simulations can be used for the systematic evaluation of the according 
interventions. 

The results of the current study also highlight the effectiveness of the counseling talk simulations as an 
intervention within the framework of teacher education programs on counseling. The exposure to realistic and 
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complex application situations allowed prospective teachers to practice and refine their professional counseling 
competences, acquire professional knowledge of counseling and learning strategies, and develop a professional 
self-concept as a counselor. Moreover, by means of the simulated parent-teacher talks, prospective teachers were 
enabled to engage in and address common problems of the professional counseling practice while they were still 
under the care and guidance of the teacher training course. Consequently, the outlined simulation approach might 
serve as an inspiration for the design of future teacher education programs on parent or student counseling. In 
this context, the video recording of the simulated counseling talks could be used for the subsequent joint analysis 
of participants’ counseling behavior, in order to provide prospective teachers the opportunity to conduct detailed 
self-evaluations and reflect on multiple aspects of their professional performance, which is considered to be a key 
element in the context of integrating theoretical knowledge and practical skills (Ericsson, Krampe, & 
Tesch-Romer, 1993; Parsons & Stephenson, 2005). Particularly in research on teacher education, the importance 
of reflection following active learning for the long-term development of practical competences is consistently 
highlighted (Admiraal et al., 2011; Watts & Lawson, 2009). As reflections induced by watching video recordings 
of one’s own professional practice have been shown to be beneficial in the context of acquiring professional 
competences in teacher education programs worldwide (Bryan & Recesso, 2006; Rich, Recesso, 
Allexsaht-Snider, & Hannafin, 2007), even the analysis of the videotaped simulated counseling talks might 
support prospective teachers in developing their professional counseling competences. Here, the focus of the 
self-reflections should be on the identification of potential differences between participants’ beliefs regarding 
good counseling and their actual practices (Bryan & Recesso, 2006; Rich & Hannafin, 2008) as well as the 
recognition of individual strengths and weaknesses of their counseling behaviors (Rich et al., 2007; Wu & Kao, 
2008). This might lead to the setting of specific individual learning goals, a heightened motivation to improve 
one’s own counseling competence, and an increased personal responsibility for one’s own learning processes 
(Andrade & Valtcheva, 2009). Finally, this might result in a long-term increase in participants’ counseling 
competence (Rich et al., 2007; Taras, 2010) and professional self-concept (Beijaard, Meijer, & Verloop, 2004). 

In addition to the one-time recording and watching of a simulated parent-teacher talk for the determination of 
prospective teachers’ current counseling competence, the viewing of videotaped simulations recorded at different 
times could provide participants the opportunity to observe their individual progress over the course of the 
specific teacher training program (Tripp & Rich, 2012). In addition to individually watching and reflecting on 
the videotapes, prospective teachers should be provided the opportunity to collaboratively watch and discuss 
their videos with peers in a learning group (Harford, MacRuairc, & McCartan, 2010), as evidence-based 
feedback and suggestions for improvement from a discussion group might also encourage efforts for continuing 
professional development (Tripp & Rich, 2012). In this connection, prospective teachers should be given 
feedback not only by peers but also by educators. In this case, the feedback should provide prospective teachers 
with information on their individual strengths and areas for improvement as well as encourage reflections on 
their counseling behavior in the past simulation and, on that basis, support the preparation for the next simulation. 
However, not only the individual participant but also the entire learning group could benefit from the 
collaborative analysis of the simulation videos, as the viewing of video cases represents a powerful instructional 
tool in developing teacher competences (Brophy, 2004) and professional identities (Maclean & White, 2007). In 
terms of model learning, prospective teachers can learn about effective professional practice by observing the 
successes and struggles of others taking part in the simulations and the subsequent self-evaluation of their own 
practice (Masingila & Doerr, 2002). This has been demonstrated for skills relevant to communicating with 
parents, in particular (Walker & Dotger, 2012). Activities involving video analysis, moreover, have the potential 
to meaningfully guide the acquisition, activation, and application of prospective teachers’ knowledge (Seago, 
2004) and help them to relate their university learning to their later professional practice (Marsh & Mitchell, 
2014). Furthermore, the introduction of video models contributes to prospective teachers’ understanding of the 
expectations regarding their later professional performance (Baecher, Kung, Jewkes, & Rosalia, 2013). 

4.1 Limitations and Outlook 

Although the current study yielded important new findings for the assessment and improvement of prospective 
teachers’ counseling competence, the results must be viewed in light of several limitations that may be addressed 
in future studies. 

Firstly, it has to be mentioned that the application of the counseling talk simulations as an assessment instrument 
as well as an intervention requires an extensive amount of resources. Consequently, for the assessment of 
teachers’ counseling competence in the context of studies with large sample sizes, the utilized scenario test 
(Binder, 2011; Gerich et al., 2015) still appears to be the method of choice, as it allows for the context specific 
and standardized measurement of teachers’ counseling competence in a highly economical manner (cf., Hedlund 
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et al., 2006). Nevertheless, the counseling talk simulations turned out to be appropriate within the framework of 
teacher education programs on counseling with smaller numbers of participants such as in the current study. 
However, as our results are based on a relatively small sample, they may not necessarily be generalizable to the 
entire population of prospective teachers. Therefore, additional studies should focus on the replication of the 
outlined findings on the basis of a larger set of participants. 

Another limitation concerns the inconsistent assessments determined by means of the simulations and the scenario 
test regarding the intervention effects of the training program on prospective teachers’ coping skills. A possible 
reason for this may consists in certain weaknesses of the applied rating system for the analysis of participants’ 
coping skills within the simulations. On this account, future research should focus on the continuing optimization 
of the rating system, particularly regarding the competence dimension coping skills. However, the divergent 
results delivered by the two instruments may also be caused by the different requirements of the simulation 
context and the scenario test completion context. Within the simulations, participants must react immediately to 
the simulated parent’s questions and statements, whereas they have the possibility to carefully consider their 
responses while completing the paper-pencil scenario test. This difference might become particularly apparent 
when participants are challenged to cope with difficult situations in the course of the counseling talk. In this 
context, consideration could also be given to the differing extent of evoking socially desirable behavior. It is 
conceivable that the social observation context and the direct interaction with a conversational partner within the 
simulations lead to more socially desirable responses (e.g., refrain from criticism) than the completion context of 
the scenario test. Consequently, additional possible reasons for the divergent results of the two instruments 
concerning the dimension coping skills are specific weaknesses of the scenario test, namely an insufficient 
suitability for the representation of difficult situations in a parent-teacher talk. Therefore, future research should 
also focus on the further validation of the scenario test regarding the assessment of participants’ coping skills. 
However, it should be noted that even the counseling talk simulations have a certain laboratory character. 
Although the implementation of simulated parent-teacher talks allows for the observation of actual behavior in 
concrete, realistic application contexts, the simulations are still based on role-playing with standardized parents. 
Thus, with special regard to validation in the field, data collected by means of the counseling talk simulations 
may be compared with video recordings of real parent-teacher talks in teachers’ professional routines. 

An additional limitation of the current study concerns the missing intervention effects of participation in the 
counseling talk simulations on the development of prospective teachers’ communication skills, diagnostic skills, 
and experience. A possible explanation may be that prospective teachers participated in the simulations only on 
two occasions. In this context, the beneficial effects of providing participants more frequent and repeated 
opportunities to practice their professional counseling competences and, consequently, gain essential experience 
should be investigated in subsequent studies. As already mentioned above, continuing research might also 
address the examination of additional beneficial effects of standardized individual feedback concerning 
prospective teachers’ counseling performance during the counseling talk simulations on their competence 
improvement. 

Within the framework of the continuing improvement of the counseling talk simulations, continued efforts 
should also focus on the development of additional case scenarios with varying levels of complexity and various 
types of students’ and parents’ demands. This will allow for the coordination of the selected case scenarios’ 
degree of difficulty with participants’ individual competence level as well as provide prospective teachers the 
opportunity to demonstrate and develop their counseling competences in increasingly demanding counseling 
situations. 

Finally, the simulated parent-teacher talks and subsequent feedback by peers and teacher educators could also be 
implemented in the continuing education of practicing teachers. As the videotaping of real-life parent-teacher 
talks is permitted by parents only in a very small minority of cases, the videotaping of the simulations could 
provide in-service teachers the opportunity to discuss and reflect on their professional performance in 
parent-teacher talks even in later stages of their professional career. 
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